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I.  Motivation 


The  question  whether  reconstructing  the  shape  of  an  opaque  object  by  measuring 
the  l  ight  it  reflects  is  possible  was  raised  in  Horn’s  thesis  IHO70J .  Ue  ui  I  I 
refer  to  this  as  the  shape  from  shading  problem.  He  observed  that  under  certain 
assumptions  (which  we  will  discuss  in  the  next  section),  first  order  partial 
differential  equations  describe  the  relation  betueen  the  brightness  of  a  small 
patch  of  an  object  and  the  local  surface  normal.  In  other  words  we  can  determine 
the  shape  of  an  object  by  solving  a  first  order  partial  differential  equation 
(abbreviated  in  the  following  by  (FO)PDE),  also  referred  to  as  the  Image 
Irradlance  equation. 

The  literature  about  PDE’s  is  extensive,  but  the  emphasis  is  on  higher  order 
PDE’s.  As  the  majority  of  physical  phenomena  can  be  formulated  as  second  order 
PDE’s,  these  equations  have  been  studied  the  most. 

In  this  paper  we  are  going  to  study  FOPOE’s.  Ue  try  to  summarize  the  various 
known  results  and  describe  methods  for  solving  a  given  FOPDE.  At  the  same  time 
we  keep  in  mind  that  the  equations  describe  a  physical  situation  and  therefore 
their  solutions  have  to  make  "sense".  A  major  problem  is  that  the  mathematical 
literature  deals  nearly  exclusively  with  equations  and  their  solutions  which  are 
continuous  and  have  continuous  derivatives  in  all  their  variables.  But  "real" 
objects  have  edges  and  there  the  surface  normals  are  discontinuous.  Another 
problem  are  occluding  contours  in  the  pictures  as  there  the  partial  derivatives 
of  the  function  describing  the  surface  are  discontinuous. 

It  is  intuitively  "clear"  that  if  the  FOPDE  is  discontinuous  in  some  of  its 
variables,  we  can  expect  solutions  which  have  discontinuous  derivatives.  The 
question  arises  if  we  can  have  such  solutions  also  if  the  equation  itself  Is 
continuous.  Is  it  possible  for  example  that  an  object  has  an  edge  uithout  the 
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equation  reflecting  this  fact.  The  ansuer  is  yes  and  we  mil  examine  why  and  hou 
this  can  happen.  Ue  wi  1 1  show  that  in  this  case  initial  conditions  are  going  to 
reflect  the  discontinuity. 

In  general,  a  PDE  describes  a  class  of  processes  and  not  a  a  particular 
instance  of  one  of  them.  Consider  as  an  example  the  Laplace  equation 

Af  -  0 

where  A  denotes  the  Laplace  operator  and  f  a  vectorfield.  Then  the  PDE  tells  us 
that  the  field  f  has  no  sources  and  zero  curl.  But  there  are  a  lot  of  fields 
which  fall  in  this  category.  Only  when  we  specify  some  more  conditions  about  f 
can  we  determine  the  unique  solution  of  the  equation. 

Ue  uill  study  what  kind  of  constraints  are  necessary  to  pin  down  a  unique 
solution  of  a  given  image  irradiance  equation.  An  attempt  will  be  made  to  find 
constraints  which  are  accessible,  i.e.,  which  can  be  measured. 


II.  The  shape  from  shading  problem  revisited 

There  are  basically  three  components  to  this  problem  which  ue  have  to 
understand.  They  are  the  lightsource,  the  object  and  the  viewer. 

The  exposure  of  film  in  a  camera  (for  fixed  shutter  speed)  is  proportional  to 
image  irradiance,  the  flux  per  unit  area  falling  on  the  image  plane.  Similarly, 
grey  levels  measured  in  a  electronic  imaging  device  are  quantized  measurements  of 
image  irradiance.  It  can  be  shown  that  image  irradiance  in  turn  is  proportional 
to  scene  radiance,  the  flux  emitted  by  the  object  per  unit  projected  surface  area 
per  unit  solid  angle  IH0S78] .  The  factor  of  proportionality  depends  on  to 
details  of  the  optical  system  including  the  effective  f-number. 


Scene  radiance  depends  on  the 

1)  surface  material  and  its  microstructure, 

2)  the  distribution  of  light  source,  and, 

3)  the  orientation  of  the  surface. 

Consider  a  viewer-oriented  coordinate  system  with  the  viewer  located  far  above 
the  surface  on  the  z-axis.  If  the  objects  imaged  are  small  compared  to  their 
distance  from  the  viewer,  one  can  approximate  the  imaging  situation  by  an 

orthographic  projection, 

x’  =  x(f/zg)  y’  -  ytf/zgi 

where  (x'.y*)  are  the  coordinates  of  the  image  of  a  point  (x,y,z)  made  with  a 

system  of  focal  length  f,  uhen  the  viewer  is  at  distance  Zg  above  the  origin.  Ue 

?  7  7  7 

assume  that  (xc  y*-  +  r  )  €  zg  . 

The  orientation  of  a  patch  of  the  surface  can  be  specified  by  given  its 
gradient  (p.q).  where  p  and  q  are  the  first  order  partial  derivatives  of  z  uith 
respect  to  x  and  y.  For  a  particular  surface  material  and  a  particular 
distribution  of  light  sources,  scene  radiance  ui  1 1  depend  only  on  surface 

gradient.  This  function,  R(p,q),  (or  a  contour  representation  in  gradient 
space),  is  called  the  reflectance  map. 

If  L(x,y)  in  the  scene  radiance  calculated  form  the  observed  image  irradiance 
at  the  point  (x'.y')  in  the  image  then 

R (p, q)  -  L(x,y)  (2.2) 

where  (p.q)  is  the  gradient  at  the  corresponding  point  on  the  object  being 

imaged.  This  equation  is  called  the  image  Irradiance  equation.  It  is  clearly  a 
first  order  partial  differential  equation  since  it  involves  only  the  partial 

derivatives  p  and  q  and  the  coordinates  x  and  y. 

A  word  of  caution:  we  are  not  dealing  with  several  issues  like  mutual 


illumination,  shadou9  and  specularity. 


III.  Basics 

For  simplicity  of  exposition  ue  uill  only  deal  with  partial  differential 
equations  involving  a  function  z  of  two  variables  x  and  y.  It  is  more  or  less 
"obvious"  hou  to  generalize  the  results  to  functions  of  n  variables.  Ue  will 
denote  z  and  z  -  the  partial  derivatives  of  z  with  respect  to  x  and  y  -  by  p 

x  y 

and  q  respectively.  Then  the  relation 

F (x,y,z,p,q)  -  0  (3.1) 
is  called  a  first  order  partial  differential  equation.  A  function  z(x,y)  is 
called  a  solution  of  (3.1)  if  in  some  region  of  the  x-y  plane  the  function  and 
its  derivatives  satisfy  the  equation  identically  in  x  and  y.  Such  a  function  is 
also  called  an  integral  surface. 

Uhen  solving  a  partial  differential  equation  ue  uant  to  find  the  "general" 
solution  uhich  is  a  uhole  "set"  of  solutions.  By  imposing  some  additional 
constraints  we  can  find  the  particular  solution  in  uhich  ue  are  interested.  Such 
constraints  can  be  for  example  boundary  conditions  or  initial  values.  In  a  later 
section  ue  uill  state  precisely  uhat  ue  mean  by  a  "general"  solution  and  what 
kind  of  constraints  are  necessary  to  pin  doun  the  desired  solution. 

The  relation  (3.1)  is  a  linear  PDE  if  it  is  linear  in  z,  p  and  q  with 
coefficients  depending  only  on  x  and  y  and  (3.1)  is  quasi -I  inear  if  it  is  linear 
in  p  and  q  uith  coeffic-ents  depending  on  x,  y  and  z. 

Unless  otheruise  stated  ue  uill  assume  that  F,  z  and  all  relevant  derivatives 
exist  and  are  continuous. 
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IV.  The  quasi-linear  first  order  PDE 


Ue  will  first  consider  this  special  PDE  as  its  geometric  interpretation  is 
rather  clear  and  so  the  relevant  method  for  solving  it  can  be  explained  and 
understood  easily.  In  this  case  the  relation  (3.1)  can  be  rewritten  as 

a(x,y,z)p  +  b(x,y,z)q  »  c(x,y,z)  (4.1) 

To  rule  out  trivial  cases  we  ui  1 1  further  assume  that 

a2  +  b2  *  0 

Ue  will  try  to  find  solutions  to  (4.1)  given  implicitly  by 

G(x,y.z)  -  0  (4.2) 

Differentiating  (4.2)  with  respect  to  x  and  y  gives  us 

Gy  +  Gzzx  =  0  and  Gy  +  GzZy  «  0  (4.3) 

or  equivalently 


zx='Gx/Gz  and  zy  “  "  Gy/Gz  (4’3,) 

Using  (4.3’)  in  (4.1)  we  get 

a (x. y, z)Gy (x, y, z)  +  b(x,y,z)Gy(x,y,z)  +  c(x,y,z)Gz(x,y,z)  -  0  (4.4) 

Note  that  in  general  (4.1)  is  a  nonlinear  PDE  for  the  function  z(x,y)  whereas 
(4.4)  is  a  linear  PDE  for  G(x,y,z).  Ue  can  interpret  the  coefficients  a(x,y,z)t 
b(x,y,z),  c(x,y,z)  in  (4.4)  as  the  components  of  a  vectorfield 
H  .  tt(x,y  ,z)  -  (a (x, y , z) , b (x, y , z) ,c(x,y,z)l . 

Then  we  can  rewrite  (4.4)  as 


<ST,VG>  -  0  (4.5) 

where  VG  denotes  the  gradient  of  G  and  <  ,  >  the  inner  product  of  two  vectors. 

Ue  knou  that  at  each  point  VG  is  perpendicular  to  the  surface  defined  by 
G(x,y,z)  and  the  equation  (4.5)  tells  us  that  B  is  perpendicular  to  VG.  Thus  W 
has  to  lie  in  the  tangent  plane  of  the  integral  surface  defined  by  G(x,y,z). 

Let  us  introduce  the  notion  of  a  fieldline  of  a  vectorfield.  By  a  fieldline 


we  understand  a  curve  whose  tangent  at  every  point  has  the  direction  of  the 
fieldvector  there.  Then  an  integral  surface  can  be  built  up  from  fieldlines 
(called  characteristics  in  this  context)  of  the  vectorfield  0.  To  reiterate  the 
previous  statements:  The  tangent  at  each  point  of  a  characteristic  has  the  same 
direction  there  as  the  vector  0  and  therefore  by  virtue  of  (4.5)  the  same 
direction  as  the  tangent  plane  of  the  integral  surface  G(x,y,z).  This  does  not 
mean  that  each  quasi-l  inear  PDE  has  a  single  solution.  Such  a  POE  only 
constrains  the  possible  orientations  of  the  tangent  planes  at  each  point  to  a 
one-parameter  manifold.  As  (4.1)  is  linear  in  p  and  q  all  feasible  tangent 
planes  at  every  point  of  an  integral  surface  intersect  in  a  line  which  is  called 
the  ttonge  axis.  Thus  finding  a  solution  to  (4.1)  means  finding  a  surface  uhich 
at  each  point  has  the  direction  of  the  flonge  axis  (the  direction  of  the  vector 
tf)  as  its  tangent  direction. 

Let  us  now  describe  a  method  of  finding  the  characteristic  curves,  which  can 
be  written  as  functions  of  one  parameter  x=x(s),  y*y(s)  and  z«z(s).  Then 
K(s)  -  (x  (s) ,  y  (s) ,  z  (s)  J  (where  '  denotes  differentiation  with  respect  to  s)  has  the 
same  direction  as  0  and  therefore  the  outer  product  of  j(s)  and  0  has  to  be 
zero. 

bz  -  cy  =0 

cx  -  az  -  0  (4.B) 

ay  -  bx  -  0 

The  relation  (4.6)  is  normally  written  as 

dx  :  dy  :  dz  «  a  :  b  :  c  (4.7) 

The  solutions  of  the  equations  (4.7)  comprise  a  tuo-parameter  family  of  curves 
in  space  (the  characteristics).  We  know  that  only  a  one-parameter  subset  of  them 
generate  the  solutions  of  the  PDE  .  To  find  this  subset  ue  introduce  an 
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arbitrary  function  between  the  tuo  free  parameters  we  get  solving  (4.7).  So  the 
general  solution  of  (4.1)  contains  an  arbitrary  function  of  one  parameter. 

Now  we  are  able  to  summarize  all  the  previous  stated  results  a3  follows:  Each 
surface  which  is  produced  by  a  one-parameter  family  of  characteristics  is  an 
integral  surface.  Conversely  each  integral  surface  is  generated  in  such  a 
fashion. 

The  first  statement  should  be  clear  by  now  (otherwise  this  is  not  a 
comprehensive"  guide  to  first  order  PDE’s).  To  understand  the  second,  remark 
the  fo I  I ow i ng. 

On  each  integral  surface  z  -  z(x,y)  the  equations 


dx 

—  =•  a(x,y,z) 
ds 


dy 

—  =  b(x,y,z) 
ds 


define  a  one-parameter  family  of  curves:  x  ■=  x(s)  ,  y  -  y(s)  ,  z  -  z  (x(s)  ,y  (s) ) . 
Note  that  on  such  a  curve 

dz 

—  -  c(x,y,z) 

ds  as 


dz 

ds 


dz  dx  8z  dy 
dx  ds  dy  ds 


azx  +  bzy 


c 


examp  I e: 


F (x,y, z,p,q)  ■  xp  +  yq  -  z  -  8 
Then  the  equations  for  the  characteristics  (4.7)  are 

dx  :  dy  :  dz  ■  x  :  y  :z 

and  have  as  their  solution  the  two-parameter  curves  in  space 
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y  -  Cjx 

(*) 

Z  = 

Now  we  introduce  an  arbitrary  function  w  between  the  two  constants:  w(Cj)  -  C2 
to  find  a  one-parameter  subset  of  (*) 

z  y 

-  «  C2  -  w(Cj)  -  w(-) 
x  x 

solution  of  the  PDE  :  z  =  u(y/x)x 

or  in  parameter  form  :  y  -  C^x  and  z  *  w(Cj)x. 


V.  Method  of  characteristics  for  general  first  order  PDE's 

Ue  want  to  apply  similar  methods  as  developed  in  section  IV  to  the  general 
first  order  PDE 

F(x,y,z,p,q)  «  0  (5.1) 

To  exclude  trivial  cases  we  will  assume  that 

F  2  +  F  2  *  0 
P  d 

Our  goal  is  to  transform  the  problem  of  finding  a  solution  to  (5.1)  to  the 
problem  of  integrating  a  set  of  ordinary  differential  equations.  Again 
geometrical  reasoning  will  help  us  find  these  equations. 

Let  us  fix  a  point  P  with  coordinates  (x,y,z)  on  an  integral  surface.  Then 
the  quantities  p  and  q  are  constrained  by  (5.1)  to  a  one-parameter  family  of 
curves.  (in  other  words:  Once  x,  y  and  z  are  fixed,  (5.1)  is  an  equation  for  p 
and  q.  To  write  this  equation  in  parameter  form  we  only  need  one  parameter.)  As 
p  and  q  determine  the  direction  of  the  tangent  plane  at  P,  we  have  just 
established  the  fact  that  (5.1)  constraints  the  feasible  tangent  planes  to  a  one- 
parameter  family.  The  envelope  of  the  tangent  planes  is  a  conical  surface  and  is 
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called  Monge  cone.  This  surface  can  have  several  sheets.  Then  "the 
considerations  here  refer  merely  to  a  suitable  small  range  of  tangent  planes, 
e.g.,  a  portion  of  a  sheet  of  the  cone  where  q  can  be  expressed  as  a  single¬ 
valued  differentiable  function  of  p  [C0HI52I."  Each  generator  of  this  cone 
represents  a  possible  direction  of  the  tangent  plane  at  P  and  is  called  a 
characteristic  direction.  Thus  the  integral  surface  has  to  "fit"  into  the  field 
of  Monge  cones. 

Recall  now  that  in  the  quasi -linear  case  the  Monge  cone  degenerated  to  the 
Monge  axis,  i.e.  at  every  point  the  direction  of  the  tangent  plane  was  fixed.  In 
that  case  we  proceeded  by  finding  characteristic  curves  which  at  every  point  had 
as  their  tangent  direction  the  direction  of  the  Monge  axis  there.  He  concluded 
that  the  integral  surface  is  swept  out  by  the  characteristic  curves.  Actually  we 
can  do  the  same  thing  in  the  case  of  a  genera  I  PDE,  but  we  have  to  be  a  little 
more  careful  this  time.  First  we  find  the  curves  uhich  at  every  point  have  as 
their  tangent  direction  the  characteristic  direction.  Let  such  a  curve  (called 
focal  curve)  be  given  by  x(s),  y(s)  and  z(s).  Remember  that  we  are  looking  for 
curves  which  sweep  out  the  integral  surface  z(x,y).  In  other  words  ue  want  the 
functions  x(s),  y(s),  z(s),  pis)  and  q(s)  to  satisfy  the  PDE  (5.1).  The  focal 
curves  only  determine  x(s),  y(s)  and  z(s)  and  (5.1)  give3  us  only  a  relation 
between  p  and  q.  So  we  are  one  equation  short  in  order  to  determine  p  and  q.  Ue 
will  obtain  this  equation  by  forcing  the  focal  curves  to  lie  on  the  integral 
surface.  The  focal  curves,  which  also  satisfy  this  last  condition  are  called 
characteristic  curves.  Again  the  characteristic  curves  sweep  out  the  integral 
sur  face. 

Actually  the  problem  we  are  concerned  with  is  to  find  the  integral  surface. 
So  we  have  to  go  the  "opposite"  way  from  what  was  described  in  the  preceding 
paragraphs.  Ue  will  first  find  a  set  of  equations,  called  the  characteristic 
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equations.  A  subset  of  the  solutions  of  this  set  are  the  characteristic  curves, 
from  uhich  the  integral  surface  can  be  built  up. 

In  the  following  paragraphs  ue  are  going  to  develop  the  technical  "machinery" 
to  find  an  integral  surface  of  (5.1). 

Our  first  task  is  to  find  the  equation  of  the  Monge  cone.  So  let  us  fix  a 
point  (x,y,z).  Then  uie  can  urite  p  and  q  -  which  satisfy  (5.1)  -  as  functions  of 
a  parameter  u  and  all  feasible  tangent  planes  at  (x.y.z)  can  be  expressed  as 

(Z-z)  =  (X-x)p(u)  +  (Y-y)q(u)  (5.2) 

The  envelope  of  the  planes  defined  by  (5.2)  defines  a  conical  surface  with 

vertex  at  (x.y.z),  the  Monge  cone.  (aside:  a  conical  surface  is  produced  by 

moving  a  straight  line  uhich  is  fixed  at  one  point  along  a  curve).  Ue  get  the 

equation  of  the  Monge  cone  by  eliminating  u  from  (5.2)  and  (5.3)  which  is 

obtained  by  differentiating  (5.2)  with  respect  to  u. 

(X-x)dp  (Y-y)dq 

0  - - + -  (5.3) 

du  du 

Differentiating  the  PDE  (5.1)  with  respect  to  the  parameter  u  ue  obtain 

dp  dq 

0  -  F  --  +  F —  (5.4) 

p  q 

du  du 

Assuming  that  neither  dp  and  dq  nor  Fp  and  Fq  vanish  identically  ue  get  from 

(5.2),  (5.3)  and  (5.4)  that 


- - - - -  «b.5>l 

Fp  Fq  pFp  +  qFq 

By  substituting  all  possible  values  for  p  and  q  (i.e.  all  values  for  p  and  q 
which  satisfy  (5.1)  )  we  obtain  all  generators  of  the  Monge  cone  at  the  point 
(x.y.z).  The  generators  of  the  Monge  cone  at  the  different  points  of  the 
integral  surface  define  the  tangent  direction  of  the  focal  curves.  Therefore  the 
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focal  curves  have 

to  satisfy  the 

fol lowing 

differential  equations. 

dx 

dy 

dz 

-  =  fp 

~  "  Fq 

-  -  pFp  +  qFq 

(5.6) 

ds 

ds 

ds 

Let  z  =  z (x, y) 

be  an  integral 

surface  on  which  ue  also  know  p  and  q. 

Then  the 

equat i ons 

dx 

dy 

— 

■  pp 

-  ’  pq 

(5.7) 

ds 

ds 

define  a  one-parameter  family  of  curves. 

On  these  curves 

dz  dx  dy 

"  "  zx”  +  V 
ds  ds  ds 


(5.8) 


holds  and  using  (5.7)  in  (5.8)  ue  obtain 


PFP  +  qFd 


(aside:  The  above  condition  is  called  strip  condition.  "It  states  that  the 
functions  x(s),  y(s),  z(s),  p(s),  q(s)  not  only  define  a  spare  curve,  but 
simultaneously  a  plane  tangent  to  it  at  every  point.  A  configuration  consisting 
of  a  curve  and  a  family  of  tangent  planes  to  this  curve  is  called  a  strip 
(C0HI621 

So  (5.8)  states  that  the  curves  defined  by  (5.7)  are  focal  curves.  Now  we 
also  require  that  a  focal  curve  is  embedded  on  an  integral  surface:  ("By 
embedding  we  mean  that  in  the  neighborhood  of  the  projection  of  a  focal  curve  on 
the  x-y  plane  z  is  a  single-valued,  twice  continuous  differentiable  function  of  x 
and  y  (C0HIG2).")  If  we  differentiate  the  PDE  (5.1)  with  respect  to  x  and  y  we 


-J1  11  ' 
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get 


FpP*  +  Fqqx  +  Fzp  +  Fx  “  0 

FnP„  +  Fnq.. +  FZq  +  F,.  “  0 


that  py  =  qx 

ue  get 

dp  dx 

dy 

—  ■  p  —  + 

py  ' 

ds  ds 

ds 

dq  dx 

dy 

-  -  qK~  + 

qy  * 

ds  d9 

ds 

get 

"x'  p  T  *V  q 


y  P  My  q 


dp 

ds 


—  +  Fzp  +  Fx  -  0 


dq 

—  +  Fzq  +  Fy  -  0 

ds 


(5.9) 


(5.18) 


(5.11) 


Ue  can  now  summarize  the  previous  results  as  follows:  If  a  focal  curve  is 
embedded  on  an  integral  surface  then  along  the  curve  the  coordinates  x.y.z  and 
the  quantities  p  and  q  satisfy  the  following  five  ordinary  differential 
equat ions: 


dx 

dy 

r~  r- 

dz 

*  —  -  F„ 

p  q 

ds 

ds 

ds 

dp 

dq 

— 

•  -(pFz  +  fk) 

—  * 

ds 

ds 

•  PFp  +  PFq 
",qFz  +  Fy> 


(5.12) 


Let  us  now  consider  the  system  (5.12)  by  itself,  i.e.  disregarding  that  ue 
obtained  it  with  a  given  integral  surface  in  mind.  Note  first  that  F(x,y,z,p,q) 
i9  constant  along  each  solution  of  the  system  (5.12)  as 


« 
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dF 


dp  dq 


dz 


dx 


dy 


-  “  Fp"~  +  Fq-  +  Fz”  +  Fx”  +  Fy 
ds  ds  ds  ds  ds  ds 


-  -  Fp">F2  *  F*’  -  Fq*aFz  *  Fy>  ♦  *  <fq»  *  F/p  *  F/q  '  » 

Thus  F  (x,  y,  z,  p,  q)  *=  constant  is  a  solution  of  (5.12).  The  system  of  equations 
(5.12)  defines  a  four-parameter  family  of  solutions.  By  imposing  the  additional 
constraint  that  the  solutions  of  (5.12)  also  satisfy  the  PDE  (5.1)  ue  obtain  a 
three-parameter  subset  of  the  solutions,  the  characteristic  strip.  "A  space 
curve  x(s),  y(s),  z(s)  bearing  such  a  strip  is  called  characteristic  curve 

(C0HIG2)."  Ue  have  already  established  the  fact  that  a  one-parameter  subset  of 
the  three-parameter  fami ly  of  curves  sweeps  out  the  integral  surface. 

As  characteristics  depend  on  the  solution,  their  range  of  influence  cannot  be 
determined  in  advance. 

In  the  next  section  we  will  discuss  the  notion  of  a  complete  integral  and  then 
we  will  show  how  to  choose  the  appropriate  one-parameter  subset. 

So  the  problem  of  finding  a  solution  to  (5.1)  is  equivalent  to  integrating  the 
system  of  five  ordinary  differential  equations  (5.12)  which  are  also  called  the 
characteristic  equations. 


VI.  General  solution  and  complete  integral 

In  the  previous  section  we  saw  that  each  solution  of  a  general  first  order  POE 
is  swept  out  by  a  one-parameter  family  of  curves.  Thus  the  equation  of  an 
integral  surface  can  be  written  as  a  function  of  the  coordinates  x  and  y  and  of 
an  arbitrary  function  of  one  variable:  such  an  equation  is  called  the  general 


solut ion. 
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Let  us  now  assume  for  a  moment  that  we  have  a  solution  z  «  4(x,y,a,b)  of  the 
PDE  which  depends  on  two  parameters.  Then  ue  say  +(x,y,a,b)  is  a  complete 
Integral  if 

"  ^xa^yb  “  ^xb^ya 


19  not  equal  to  zero.  This  condition  assures  that  +  really  depends  on  two 

parameter,  i.e.  that  there  is  no  a  ■  g(a,b)  such  that  ♦(x.y.a.b)  -  ♦(x.y.o). 

From  the  two-parameter  family  of  planes  defined  by  4(x,y,a,b)  we  can  choose  a 
one-parameter  subset  by  introducing  an  arbitrary  function  which  relates  a  and  b, 
e.g.  set  b  ■  w(a).  Note  that  the  family  ^Ix.y.a.ula) )  is  again  a  solution  of 

the  PDE  .  The  following  idea  makes  the  concept  of  a  complete  integral 

significant:  The  envelope  of  the  family  $(x,y,a,w(a) )  is  again  a  solution  of 

the  PDE  since  at  each  point  it  touches  a  member  of  the  family  +(x,y,a,w(a) )  i.e. 
a  solution.  Or  conversely  each  point  of  the  envelope  is  a  solution  of  the  POE  . 
Ue  obtain  the  equation  of  the  envelope  by  eliminating  the  parameter  a  from  the 
two  equations: 


z  =  ♦Ix.y.a.wla)) 

♦a(x,y,a,u(a))  +  +b(x,y, a,u(a) )u’ (a)  =  0 


(6.1) 


Eliminating  the  parameter  a  from  (6.1)  yields  an  expression  involving  an 
arbitrary  function  w  of  one  variable,  which  is  a  solution  to  the  PDE  and 
therefore  we  have  found  the  general  solution.  Ue  will  now  exhibit  this  fact 
analytically.  By  differentiating  (6.1)  with  respect  to  x  and  y  we  get 


ZX  ■  ♦„  +  (*a  +  V’(a,,ax 
Zy  “  ♦y  +  (ia  +  4bu’(anay 


(6.2) 


Ue  know  that  4(*.y.a.w(a) )  is  a  solution  for  any  choice  of  the  parameter  a. 
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Using  (G.l)  (i.e.  4a  +  ^u’  (a)  »  0)  in  (6.2)  establishes  the  fact  that  for  all  x 
and  y  the  values  of  z,  zv  and  z..  are  the  same  as  those  of  +,  A  and  f 

So  if  we  know  the  complete  integral  of  a  given  POE  ue  can  obtain  the  general 
solution  by  just  using  the  process  of  differentiation  and  elimination  of 
parameters.  (This  later  process  can  in  practice  be  tedious  or  impossible,  but  is 
often  not  necessary,  as  by  plugging  in  all  different  values  for  a,  alt  solutions 
of  the  PDE  are  obtained.)  The  only  problem  uith  the  above  described  method  is 
that  there  is  no  easy  way  to  find  a  complete  integral.  In  the  next  section  ue 
ui  I  I  shou  that  with  the  help  of  the  characteristic  equations  ue  can  find  a 
complete  integral. 

The  general  solution  does  not  comprise  all  solutions  of  a  PDE  .  The  envelope 
of  the  complete  integral,  the  so  called  singular  integral,  is  again  a  solution 
uhich  cannot  be  obtained  from  the  general  solution.  The  equation  of  the  singular 
integral,  uhich  does  not  contain  any  arbitrary  elements,  is  found  by  eliminating 
the  parameters  a  and  b  from  the  equations 

z  »  ^(x,y,a,b) 

Aglx.y.a.b)  -  0  (6.3) 

♦b<x.y.a.b)  -  0 

Ue  have  assumed  all  along  that  all  eliminations  are  possible  and  that  during  the 

course  of  this  process  ue  obtain  functions  uith  continuous  derivatives. 

Actually  ue  do  not  have  to  knou  the  complete  integral  in  order  to  find  the 

singular  solution.  Note  only  that,  for  a  complete  integral,  F(x,y,+,4  ,4  ) 

*  y 

vanishes  identically  for  all  choices  of  the  parameters  a  and  b.  I  f  ue  nou 
differentiate  the  PDE  uith  respect  to  a  and  b  ue  get 


ti 
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F**a  +  Fp*xa  +  Fq*ya  “  0 

(6.4) 

F^b  +  Fp*xb  +  Fq*yb  ’  0 

As  4  is  a  complete  integral,  D  =  4xa^yb  “  *xb*ya  's  no*  *°  zero* 

Furthermore  4a  and  are  zero  (equations  (G.3)  )  and  therefore  ue  get  the 

equation  of  the  singular  integral  from  (G.4)  by  eliminating  p  and  q  from 

F  =  0  F  =  0  F  «  0  (G.5) 

p  q 

(asidetue  did  not  assume  in  this  case  that  Fp  +  Fg  <  0  as  ue  did  uhen  obtaining 
the  characteristic  equation.) 

If  the  PDE  does  not  contain  the  function  z(x,y)  explicitly  then  there  exist  no 
singular  solution  as  in  this  case  the  complete  integral  is  of  the  form 

z  -  4(x,y,a)  +  b 

and  the  condition  =  0  can  not  be  fulfilled. 

VII.  Method  for  finding  the  complete  integral 

In  the  previous  sections  we  have  shoun  tuo  methods  for  finding  the  solutions 
to  a  given  PDE  .  Now  ue  ui  1 1  shou  hou,  uith  the  help  of  the  characteristic 
equations,  ue  can  find  a  complete  integral  and  this  ui  II  also  then  be  a  uay  to 
find  a  one-parameter  subset  from  the  four -parameter  family  of  solutions  of  the 
characteristic  equations. 

First  ue  have  to  discuss  a  special  form  of  PDE  called  Pfaff’s  equation. 

f(x,y,z)dx  +  g(x,y,z)dy  +  h(x,y,z)dz  »  0  (7.1) 

In  the  case  uhen  h  c  0  and  f  and  g  depend  only  on  x  and  y  (7.1)  degenerates  to 
an  ordinary  differential  equation  uhich  is  called  an  "exact"  differential 


equat ion. 
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f(x,y)dx  +  g(x,y)dy  -  0  (7.2) 

The  equation  (7.2)  is  called  "total"  i  f  f  and  g  satisfy  the  integrability 
condi t ion 

fy(x.y)  -  9x<x,y)  (7.3) 

In  the  case  of  a  total  differential  equation  it  is  easy  to  find  a  solution  to 
(7.2).  On  each  simply  connected  region  we  can  find  a  function  H(x,y)  such  that 

aH  8H 

—  -  f(x.y)  and  —  -  g(x,y)  (7.4) 

8x  8y 

then 

dH  =  f(x,y)dx  +  g(x,y)dy 

and  the  equation  dH  =  0  is  equivalent  to  (7.2). 

Thus  H(x,y)  =  constant  is  a  solution  to  (7.2)  and  the  function  H  can  be  found 
by  integrating  (7.4). 

In  the  case  that  (7.3)  is  not  satisfied  by  the  given  equation  (7.2)  one  can 
aluays  introduce  an  "integration"  factor  p(x,y)  such  that  the  equation 

»ifdx  +  jigdy  -  0  (7.5) 

is  total,  i.e.  that  (>if)y  *  (Mg)y*  Or  equivalently  »ilx,y)  has  to  be  a  solution 
of  the  following  PDE  which  can  be  solved  with  the  method  of  characteristics. 


<«(f,i  -  g  )  +  p,.f  -  a  g  =  0 
y  *  y  * 

Now  let  us  return  to  equation  (7.1)  which  is  again  easy  to  solve  if  its  left 
hand  side  is  a  total  differential  of  a  function  H(x,y,z)  i.e.  if 


8H 

8H 

8H 

f  - 

— 

g  “ 

— 

h  -  — 

(7.G) 

ax 

ay 

0Z 

Necessary  for  (7.G)  to  hold  is 

v  at 

at 

8g 

8g 

ah 

ah  at 

—  ■ 

— 

—  —  m 

— 

—  .  — 

(7.7) 

dy 

dx 

dz 

ay 

Qj 

X 

Qj 

N 

In  a  simply  connected  area 

(7.7) 

is 

also 

sufficient 

for  the  existence  of  a 
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function  H(x,y,z)  uhich  satisfies  (7.6)  and  can  be.  calculated  as 


H(x 


(x.y.z) 

.  yifd.  +  gdy  +  hdz)  +  C 

^o-yo^o1 


where  (xg.yg.Zg)  is  a  fixed  point.  Clearly  H(x,y,z)  »  constant  is  a  solution  to 
(7.1). 

In  the  case  when  (7. 7)  is  not  satisfied  we  again  want  to  find  an  "integration" 
factor  ji(x,y,zh  such  that  the  expression  »»fdx  +  jigdy  +  jihdz  is  a  total 

differential  of  a  function.  In  comparison  to  Pfaff’s  equation  in  two  variables 

it  is  not  always  possible  to  find  such  a  factor. 

Necessary  for  jj  to  exist  is  that  the  following  equation  holds: 

f(gz  -  hy)  +  g(hx  -  fz>  +  h I f y  -  gx)  =0  (7.8) 

It  can  also  be  shown  (simple,  but  tedious)  that  in  a  simply  connected  region 

(7.8)  is  sufficient  for  (7.1)  to  possess  a  one-parameter  family  of  solutions 
H(x,y,z)  «  constant.  Ue  will  show  now  how  to  construct  such  a  function  H(x,y,z). 
First  let  us  consider  the  "abbreviated"  equation 

f(x,y,z)dx  +  g(x,y,z)dy  -  0  (7.9) 

This  is  a  Pfaff’s  equation  in  the  two  variables  x  and  y  with  z  as  a  parameter. 
Thus  we  can  always  (eventually  with  the  help  of  an  integrating  factor  X(x,y,z)  ) 
find  a  solution  to  (7.9): 

♦  (x,y)  »  u(x,y,z)  «  C  (7.10) 

Note  that 


8u 

0U 

Xf  =  — 

and  Xg  «  — 

(7.11) 

8x 

8y 

Now  we  define  a  function  S  depending  on  the  three  variables  x,y  and  z  by 
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0u 

S(x.y.z)  -  Xh -  (7.12) 

0Z 

If  we  express  -  with  the  help  of  (7.10)  -  y  as  a  function  of  x,  u  and  z,  we  can 
redefine  S  as  a  function  of  x,  u  and  z,  i.e. 


T(x,u,z)  «  S(x,y,z)  (7.13) 


Ue  will  prove  now  that  T  is  actually  independent  of  x.  Then  we  can  find 
H(x,y,z)  by  solving  another  Pfaff’s  equation  in  the  variables  u  and  z.  To  prove 
that  9T/9x  =  0  we  use  equation  (7.11)  and  (7.12)  and  obtain; 

a  8  . 

—  (Xh  -  S)  -  uxz  -  — (Xf) 

0x  dz 

a  a 

-(Xh  -  S)  -  u  -  —  (Xg)  (7.14) 

ay  az 

a  a 

—  (Xg)  -  u  -  — (Xf) 

ax  ay 

or  (equation  (7.14)  uritten  out  in  full) 


Sx  ■  hXx  -  fXz  *  X(hx  -  fz» 

-  Sy  -  9Xz  “  hxy  +  X(9Z  -  hy> 

0  »  fXy  -  gxx  +  X(fy  -  gx) 


(7.15) 

(7.1G) 

(7.17) 


Multiplying  (7.15)  by  g,  (7. IB)  by  f  and  (7.17)  by  h  and  then  adding  up  the  three 
equations  using  condition  (7.8)  gives  us 

gS  -  fS  "0 

y  x  y 

Differentiating  (7.13)  with  respect  to  x  and  y  gives  us 


(7.18) 
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0  =  gSx  -  fSy  =  gTx  +  gTuU><  -  fTuuy  - 
-  gTx  +  XfgTu  -  XfgTu  -  gTK 

As  g  *  0  we  can  conclude  that  Ty  -  0.  Thus  we  can  rewrite  (7.13)  as 

S(x,y,z)  ■  T(u,z) 

The  equation  (7.1),  after  being  multiplied  by  X  and  with  the  expressions 
(7.11)  and  (7.12)  used,  reads  now  as  follows: 

X(fdx  +  gdy  +  hdz)  -  uydx  +  uydy  +  (uz  +  T)dz  -  0 

or  equivalently 

du  +  T(u,z)dz  -  0  (7.20) 

This  is  again  a  Pfaff's  equation  in  two  variables  which  we  know  how  to  solve. 
Its  solution  is  f(u,z)  =  C.  Thus  the  solution  to  (7.1)  is 

H (x, y, z)  »  f (u(x,y,z) ,z)  «  C 
uhich  is  one-parameter  manifold. 

Finally  we  are  ready  to  describe  a  method  for  finding  a  complete  integral  of  a 
general  first  order  PDE  F(x,y,z,p,q)  =  0. 

The  basic  idea  is  that  we  can  interpret  the  total  differential  of  a  solution 
z(x,y)  of  the  PDE 

dz  «  pdx  +  qdy  (7.21) 

as  Pfaff’s  equation  in  the  variables  x,  y  and  z.  To  really  do  so  we  still  have  to 
express  p  and  q  as  functions  of  x,  y  and  z.  Now  assume  that  we  can  find  tuo 
functions  f  and  g  such  that  if  we  set 
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p  =  f(x,y,z,a)  and  q  «  g(x,y,z,a)  (7.22) 
(where  a  is  an  arbitrary  constant)  the  PDE  and  condition  (7.8)  (with  h  ■  -1) 

fgz  "  gfz  "  fy  +  gx  “  0  (7.23) 
is  satisfied.  Then  the  solution  to  (7.9)  is  a  one-parameter  manifold,  but  as  ue 
have  already  built  in  a  parameter  a  into  the  equation  (7.9)  the  solution  contains 
two  parameters  and  is  the  complete  integral.  So  we  have  to  solve  the  problem  of 
how  to  find  such  functions  f  and  g.  Ue  need  two  equations  to  do  so.  Let  U9 
assume  that  somehow  a  function  G(x,y,z,p,q)  exists  such  that  p  and  q  (or 
equivalently  f  and  g)  can  be  expressed  from  the  two  equations 


F  (x, y,  z,  p, q)  -  0 
G(x,y,z,p.q)  »  a 


(7.24) 


(aside:  thus  FpG^  -  F^Gp  *  0). 

Now  we  want  to  assure  that  f  and  g  obtained  in  such  a  fashion  satisfy  (7.23) 


identically  in  the  three  variables  x,  y  and  z.  Differentiating  (7.24)  with 


respect  to  x,  y  and  z  gives  us: 


Fx  +  pxFp  +  gxFq  =  0  Gx  +  pxGp  +  qxGq  '  0 

F  +  pF  t  q  F  «  0  G  +  pG  +  qG  «  0 

y  ip  qy  q  y  py  p  qy  q 

Fz  +  pzFp  +  gzFq  *  0  Gz  +  pzGp  +  qzGq  +  0 


(7.25) 


After  expressing  p2>  qz,  py  and  q^  from  (7.25)  and  plugging  this  expression 
into  (7.23)  we  obtain  the  linear  first  order  PDE  for  the  function  G 


FpGx  ♦.  FqGy  +  (pFp  ♦  qFq’Gz  ‘  <Fx  +  pFz,Gp  ’  ,Fy  +  qFz,Gq  *  0 


(7.26) 


Ue  can  solve  (7.26)  with  the  method  of  characteristics.  The  appropriate 


system  of  characteristic  equations  is  the  same  as  the  one  for  F(x,y,z,p,ql  •  0 


dx: dy: dz: dp: dq  -  Fp:Fq:  (p^p  +  qFq):-(pFz  +  Fx):-(qFz  +  (7.27) 

But  ue  need  now  only  one  integral  of  (7.27)  -  which  is  independent  of  F  and 
contains  at  least  one  of  the  variables  p  and  q.  Such  an  integral  is  our  desired 
function  G.  There  will  always  be  such  an  integral  as  the  solution  of  (7.27) 
comprise  a  four -parameter  family: 

Vj (x,y,z,p,q)  *  Cj  i  -  1,2,3. 4 

The  Vj  are  independent  and  at  least  one  of  them  must  contain  either  p  or  q. 

The  just  described  method  is  due  to  Lagrange  and  Charpit.  It  has  the 
advantage  over  the  method  of  characteristics  as  described  in  section  V  in  that  we 
only  need  to  find  a  single  integral  of  (7.27)  instead  of  finding  the  four- 
parameter  family  of  curves. 


VIII.  Initial-value  problem  for  linear  and  quasi-linear  PPE's 

Now  that  we  know  how  to  find  the  general  solution  of  a  given  first  order  POE 

we  will  attack  the  problem  to  determine  the  constraints  with  uhich  a  particular 

solution  can  be  found. 

Ue  will  consider  the  quasi-linear  POE 

a(x,y,z)zw  +  b(x,y,z)z,.  -  c(x,y,z)  (8.1) 

x  y 

Ue  now  want  to  find  the  integral  surface  z(x,y)  uhich  passes  through  a  given 
curve  C  in  space  (in  the  literature  referred  to  as  Cauchy’s  problem).  Clearly 
the  following  questions  have  to  be  answered: 
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1)  Uhat  conditions  on  C  are  necessary  such  that  this  problem  is  solvable. 

2)  Uhen  is  such  a  solution  unique. 

Let  C  be  given  by  continuous  differentiable  functions  of  a  parameter  t:  x(t), 
y(t),  z  ( t ) .  Furthermore  we  will  assume  that  the  projection  of  C  on  the  x-y  plane 
(later  referred  to  as  Cg)  does  not  contain  double  points  -  (without  this 
constraint  we  obtain  surfaces  with  self  intersections,  i.e.  z  is  not  everywhere  a 

single-valued  function  of  x  and  y,  uhich  implies  that  along  the  line  of 

2  2 

intersection  p  and  q  are  discontinuous)  -  and  that  x^  +  y^  *  0.  Now  to 
construct  a  solution  of  the  POE  which  contains  C  we  lay  through  each  point  of  C  a 
characteristic  curve  whose  equations  depend  now  on  two  parameters: 

x  *  x(s,t)  y  =  y(s,t)  z  =  z(s,t)  (8.2) 

Note  that  the  functions  x,  y,  z  are  still  continuous  differentiable.  To  get  the 
equation  of  the  integral  surface  we  have  to  eliminate  the  parameters  s  and  t  from 
the  equations  (8.2),  i.e.  we  have  to  express  s  and  t  in  terms  of  x  and  y.  A 
sufficient  condition  to  do  so  is  that  the  functional  determinant  A  as  specified 
in  (8.3)  does  not  vanish  along  the  curve  C. 

A  =  xgyt  -  ygxt  (8.3) 

[aside:  using  the  characteristic  equations  we  can  rewrite  (8.3)  as 
A  =  ayt  -  bx^] 

Thus  if  A  *  0  we  can  express  z  as  a  function  of  x  and  y  and  it  is  assured  that  C 
lies  on  the  surface.  The  solution  is  also  unique  which  follows  from  the 
following  I  emma: 

Each  characteristic  curve  which  has  one  point  in  common  with  an  integral 
surface,  lies  completely  on  this  surface. 

The  proof  of  this  lemma  is  the  uniqueness  theorem  for  solutions  of  ordinary 
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differential  equations. 

The  determinant  A  can  be  interpreted  as  the  outer  product  of  the  two  vectors 


and  (2  “  ^  J 

which  are  the  projections  of  the  tangent  and  the  characteristic  direction  on  the 
x-y  plane.  In  the  special  case  when  A  vanishes  along  C  these  tuo  directions 
coincide  and  we  can  deduce  that  C  has  one  of  the  three  properties  listed  below: 

1)  C  is  a  characteristic  curve. 

2)  C  is  the  envelope  of  the  characteristics,  (called  edge  of  regression) 

3)  Co  is  the  envelope  of  the  projections  of  the  characteristics  on  the  x-y 


plane. 

Let  us  first  discuss  case  1).  From  A  =  0  we  get 

*t  «t 


a  b 

If  we  use  x(t)  and  y(t)  (from  the  equation  for  C) 
equation  has  to  hold  along  C: 


(8.4) 

in  z(x,y)  then  the  fol lowing 


dz 

dt 


dx 


dy 


Zx~  +  Zy~-  ■  3ZX  +  bZy 

dt  dt 


c 


Or  equivalently  we  can  say  that  C  satisfies  the  characteristic  equations  and  is 
therefore  a  characteristic  curve.  Obviously  the  solution  of  the  PDE  is  not 
unique  in  this  case.  Actually  in  the  case  when  C  is  a  characteristic  curve  there 
exist  infinitely  many  surfaces  through  C  uhich  satisfy  the  PDE  .  To  see  that 
just  choose  another  curve  C'  along  uhich  A  vanishes  and  which  has  a  point  P  in 
common  uith  C.  Now  to  construct  the  solutions  through  C'  one  lays  the 
characteristic  through  every  point  of  C’,  in  particular  also  through  P,  (i.e.  the 
characteristic  curve  through  P  is  C).  Thus  an  integral  surface  through  C’ 
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contains  C.  In  such  a  way  infinitely  many  integral  surface  can  be  constructed 
which  contain  C.  They  meet  along  the  characteristic  curve  and  we  can  say  that  C 
is  a  branch  curve. 

One  assumption  we  had  made  should  be  stressed  here  again:  ue  were  looking  for 
solutions  of  the  PDE  which  in  the  neighborhood  of  C  are  continuous  and  are 
continuous  differentiable.  It  might  be  possible  to  find  a  solution  z  through  C, 
along  which  A  vanishes,  without  C  being  characteristic.  These  are  the  cases  2 
or  3  as  mentioned  above.  But  then  the  derivatives  of  z  are  not  continuous  on  C. 
Let  us  illustrate  this  problem  with  an  example. 

examp  I  e 

2 

Ftx.y.z.p.q)  -  3(z  -  y)  p  -  q  -  0 
characteristic  equations: 

dx 

—  =  3(z  -  y)2 
ds 

dy 

—  -  -1  <*) 
ds 

dz 

—  -  0 

ds 

solution  of  (*)  with  initial  values  x0,  y0,  Zg: 

x  -  (z0  -  y0  +  s)3  +  x0  -  (z0  -  y0) 3 

y  =  -  s  +  y0  (**) 

z  -  Zg 

Ue  want  the  solutions  (**)  pass  through  C  given  by: 

x  *  0  y=t  z  -  t 
Note  that  C  is  not  a  characteristic. 

So  we  set  the  initial  values  x0,  y0,  z0  (i.e.  x.y.z  for  s  -  0)  as 
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Th  i  9  lemma  is  not  satisfied  if  C  is  an  edge  of  regression  or  C0  is  the  envelope 
of  the  projection  of  the  characteristic  curves  on  the  x-y  plane,  (cases  2  and  3 
in  the  above  I i st) . 

In  the  case  of  a  linear  PDE  ue  can  make  some  more  statements  about  the 
solution  if  A  vanishes  along  C.  Ue  mil  show  that  in  this  case  the  integral 
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surfaces  are  cylindrical  surfaces  perpendicular  to  the  x-y  plane,  i.e.  that  the 
solution  is  independent  of  z.  The  PDE  is 

a(x,y)p  +  b(x,y)q  «  c(x,y) 

Recall  that  A  is  defined  as 

A  -  xsyt  -  *ty3 

Note  that  if  Ag  (i.e.  the  partial  derivative  of  A  with  respect  to  s)  and  A 
vanish  along  C,  then  A  vanishes  everywhere.  (proof:  existence  and  uniqueness 
theorem  for  ordinary  differential  equations.) 

Using  the  characteristic  equations: 


we  obtain  for  Ae 


xs  =  a 


y3  -  b 


(*) 


As  -  asyt +  ayst  -  bsxt  -  bxst  ■ 

-  agyt  +  abt  -  bgxt  -  atb 

Differentiating  a  and  b  with  respect  to  s  and  t  and  using  relations  (*)  we  get 


a  *=  a  a  +  a  b 
s  x  y 


at  •  axxt  +  Vt 

bS  ■  bxa  +  byb 

bt  "  Vt  +  Vt 


and  then 


A  «=  (a  +  b  )  A 
s  x  y 

Ue  uant  to  express  x  as  a  function  of  y  and  z,  i.e.  x  -  f(x,y)  and  so  we  assume 
that  ygz^  -  zgyt  <•  0  along  C.  Then  ue  will  proceed  shouing  that  fz  -  0,  which 
will  prove  that  the  integral  surface  z  is  a  cylindric  surface. 

Differentiating  x  with  respect  to  s  and  t  we  obtain 

xs  -  Vs  +  fzzs 


xt  -  Vt +  Vt 
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then 

A  -  fz(z3yt  -  zty9) 

from  which  it  follows 


IX.  Initial-value  problem  for  general  first  order  PPE's 

Ue  have  seen  that  the  problem  of  finding  a  solution  to  a  general  first  order 

PDE  is  equivalent  to  solving  the  system  of  characteristic  equations.  Again  we 

are  posing  the  question  about  what  kind  of  constraints  determine  a  solution 

uniquely.  Clearly  we  need  more  than  in  the  quasi -linear  case,  as  now  the  the 

solutions  to  the  characteristic  equations  form  a  three-parameter  family  of 

curves.  So  let  C  be  a  curve  given  by  x ( t ) .  y(t),  z(t)  such  that  neither  C  nor 

its  projection  on  the  x-y  plane  have  double  points.  Furthermore  we  have  to 

specify  pit)  and  qlt)  along  C  such  that  the  condition 

dz  dx  dy 
—  -  p—  +  q— 
dt  dt  dt 

and  the  POE  (5.1)  (i.e.  F  *  0)  holds  identically  in  t.  Ue  say  that  the  function 
x(t),  y(t),  z(t),  pit),  qlt)  define  an  initial  integral  strip  denoted  by  Cj. 
From  now  on  the  procedure  is  very  similar  to  the  one  for  solving  the  initial 
value  problem  for  a  quasi-l  inear  PDE  .  So  through  every  element  of  Cj  we  lay  a 
characteristic  strip,  which  then  can  be  written  as  x(s,t),  yls.t),  zls.t), 
pls.t),  q Is,  t ) .  To  express  the  parameters  s  and  t  in  terms  of  x  and  y  we  demand 

A  ■  *9yt  -  *tys  -  FPyt  -  Fq*t 


^  -  - 


that 
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does  not  vanish  identically  along  the  initial  strip.  Then  z,  p  and  q  can  be 
expressed  in  terms  of  x  and  y.  I4e  only  have  to  make  sure  that  p  and  q  written  in 
such  a  fashion  are  the  partial  derivatives  of  the  integral  surface  z(x,y).  Thus 
we  have  to  show  that  the  quantities  l)  and  V 


U  «  zt  -  pxt  -  qyt 
V  -  zs  -  pxg  -  qyg 


(9.1) 


vanish  identically.  As  ue  have  assumed  that  A  *  0  we  can  deduce  from  (9.1)  and 


0  ’  zt  "  zxxt  "  zyyt 
0  "  zs  -  zxxs  ‘  zyzy 


that  zx  -  p  and  z  -  q.  Recall  now  the  characteristic  equations: 


pfP  *  *  „ 


dx 

dy 

dz 

—  = 

FP 

'  "  Fq 

— 

ds 

ds 

ds 

the 

last 

we  obtain 

dz 

dx 

dy 

—  -  p— 

q— 

ds 

ds 

ds 

which  implies  V  a  0. 
Now  to  prove  U  s  0: 


(9.2)  -  (9.3); 


-  zgt  -  pgxt  -  pxgt  -  qgyt  -  qygt 


it  -  PtXS  ~  pX9t  '  -  Py3t 


au  av 

- (p9xt  '  PtX9  +  q3yt  -  '’tys1 

as  at 


(9.2) 


(9.3) 


(9.4) 
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Taking  into  account  the  characteristic  equations  and  the  fact  that  V  ■  8  implies 
3V/9t  -  0  we  can  rewrite  0.4)  as 

au 

—  ’  PtFp  +  PtFq  +  xtFx  +  ytFy  +  (pxt  +  qyt)Fz  (9,5) 

9s 

But  ue  know  that  the  PDE  F  =  0  holds  identically  in  s  and  t.  Differentiating  F 
wi th  respect  to  t: 

Fxxt  +  Fyy t  +  Fzzt  +  Fppt  +  Fqqt  ■  0  (9*6) 

(9.G)  in  (9.5) : 


au 


For  any  fixed  t  this  is  an  ordinary  differential  equation  for  U  as  a  function  of 
s  with  the  solution: 


/  Fz-e 

U(s)  -  U(0)e° 


As  by  assumption  U(0)  is  zero,  U  vanishes  everywhere. 

To  summarize  the  previous  results:  given  a  curve  x(t),  y(t),  z(t)  along  which 
we  also  know  p(t),  q(t)  such  that 


dz  dx  dy 

—  -  p—  +  q— 
dt  dt  dt 

F(x(t)  ,y(t)  ,z(t)  ,p(t)  ,q(t) )  »  0  and  A  -  Fpy^  -  F^x^  *  0,  then  there  exists  an 
unique  integral  surface  through  the  initial  strip.  Ue  get  a  unique  surface 
because  the  solution  of  the  characteristic  equations  is  uniquely  determined  by 
its  initial  values. 

The  exceptional  case  when  A  *  0  along  Cj  is  analogous  to  the  one  discussed  in 
the  previous  section:  there  are  infinitely  many  integral  surfaces  through  Cj  if 
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and  only  it  is  a  characteristic  strip.  Again  we  can  say  that  the  characteristic 
curves  are  branch  elements  as  on  either  side  there  can  be  another  member  of  the 
family  of  solutions  of  the  PDE  while  we  are  assured  that  along  C  the  first 
derivatives  are  continuous. 

If  Cj  is  only  a  focal  strip  along  which  A  =  0,  then  it  might  be  still 
possible  to  find  an  integral  surface  z  through  it.  But  analog  to  the 
quasi -I  inear  case,  z  will  not  have  continuous  derivatives. 

The  last  case  we  will  discuss  is  if  C  degenerates  to  a  point  P  ui  th 
coordinates  Ixg.yg.Zg).  Then  the  strip  condition  is  identically  satisfied  for 
all  Pg  and  q0  which  also  satisfy  the  PDE,  i.e.,  for  all  p0  and  q0  which  determine 
the  feasible  tangent  planes  in  P.  Thus  we  can  write  p0  and  q0  as  functions  of  a 
parameter  t.  1  f  we  plug  the  quantities  x0,  y0,  z0,  p0(t),  q0(t)  in  the  PDE  ue 

obtain  an  integral  surface  which  is  in  this  case  a  conical  surface  with  vertex  at 

P*  It  is  called  the  integral  conoid  of  the  partial  differential  equation  at  P. 

It  can  be  shown  that  the  solution  to  the  Cauchy  problem  can  also  be  found  by 

constructing  the  appropriate  integral  conoids.  The  integral  surface  is  the 
envelope  of  the  integral  conoids  whose  vertices  lie  along  a  given  curve  C. 


In  the  preceding  chapters  we  dealt  with  FOPDE’s  which  are  continuous  and  have 
continuous  derivatives  in  all  their  variables.  Ue  showed  that  the  problem  of 
finding  a  solution  to  a  given  FOPDE  is  equivalent  to  solving  a  system  of  ordinary 
differential  equations.  By  imposing  "suitable"  initial  conditions,  a  unique 
solution  can  be  found. 

But  recall  that  our  motivation  for  studying  FOPDE’s  was  to  be  able  to  solve 
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the  image  irradiance  equation: 

R(p.q)  «  L(x,y)  (10.1) 

This  equation  has  two  properties  which  we  are  going  to  exploit.  First  the 
function  z  does  not  appear  explicitly  in  the  equation  and  therefore  no  singular 
integral  surface  exists.  Second  the  equation  can  be  written  as  the  difference  of 
two  functions,  where  one  depends  only  on  p  and  q  whereas  the  other  depends  solely 
on  x  and  y.  Ue  will  use  this  fact  to  deal  with  discontinuities. 

Let  us  first  review  the  case  when  (10.1)  is  a  linear  equation  (note  that 
(10.1)  cannot  be  quasi  - 1  inear !) ,  i.e; 

p  +  q  -  Kx.y) 

Ue  assume  that  L(x,y)  is  continuous  and  has  continuous  first  derivatives.  Let  C 
be  an  initial  curve  given  in  parameter  form:  x  =  x(t),  y-y(t)  and  z  »  z(t). 
If  the  A  (as  defined  in  section  VIII)  does  not  vanish  along  C,  then  ue  have  a 
unique  solution.  It  is  continuous  and  has  continuous  derivatives  if  C  is  a 
continuous  differentiable  function  of  the  parameter  t.  "Any  singularities  of  the 
initial  data  propagate  in  the  x-y  plane  along  the  projection  there  of  the 
relevant  characteristic  curve  [GARB4I."  This  is  not  surprising  as  characteristic 
curves  can  be  vieued  as  branch  curves  in  which  two  integral  surfaces  meet.  Note 
also  that  higher  order  derivatives  may  be  discontinuous  along  characteristic 
curves. 

In  the  case  when  C  or  its  projection  onto  the  x-y  plane  has  double  points,  the 
integral  surface  has  self  intersect  ions,  i.e.  z  is  not  a  single-valued  function 
of  x  and  y.  This  is  not  a  case  of  interest  for  us.  as  we  can  "see"  only  one  value 
of  z.  Note  that  a  Hobius-strip  is  not  a  contradiction  to  the  above  assertions,  as 
it  is  not  an  opaque  object.  In  a  case  like  that  of  a  Mobius-strip  mutual 
illumination  and  shadows  are  essential  for  deducing  the  shape  of  the  object. 

If  A  vanishes  along  C,  then  C  is  either  a  characteristic  curve  and  ue  get 
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infinitely  many  solutions  or  we  get  a  solution  whose  derivatives  are  not 
continuous  along  C.  This  second  case  is  of  special  interest  to  us.  Assume  we 
could  specify  such  a  C.  This  would  imply  that  there  is  for  instance  an  edge  which 
we  do  not  see,  as  it  is  neither  reflected  in  the  equation  itself  nor  in  the 
initial  data.  But  luckily  this  cannot  happen.  In  the  linear  case  the 
characteristic  equations  are: 

Xg  -  1  and  yg  -  ±1 

Thus  for  A  to  vanish  x^  -  y^  which  is  equivalent  to  saying  that  x(t)  and  y(t) 
have  to  satisfy  the  characteristic  equations. 

Now  we  will  discuss  the  general  image  irradiance  equation.  Again  we  will 

assume  that  R(p,q)  and  L(x,y)  are  continuous  and  have  continuous  first 

derivatives.  In  deriving  the  system  of  characteristic  equations  we  assumed  that 

the  integral  surface  z  also  has  continuous  second  derivatives  [we  used  this  fact 

in  equation  15.10]  to  deduce  that  p  =  q  ].  In  [MY48,  PL154]  it  was  shown  that 

y  * 

an  integral  surface  can  be  build  from  characteristic  strips  also  in  the  case  when 
only  the  first  derivatives  are  continuous. 

Ue  want  the  integral  surface  to  pass  through  a  curve  C  again  given  in 
parameter  form  by  x  =  x(t),  y  =  y(t)  and  z  *  z(t).  Then  we  can  determine  pCt) 
and  q(t)  along  C  by  solving  the  two  equations: 

R(p(t),q(t)»  >  L(x(t) ,y(t) )  (10.2) 

dz  dx  dy 

-  -  p(t) —  +  q(t) —  (10.3) 

dt  dt  dt 

which  we  consider  here  to  be  algebraic  (not  differential)  and  solved  over  the 
reals.  As  (10.2)  is  nonlinear,  we  may  get  zero  or  several  solutions  for  p(t)  and 
q(t).  Thus  only  for  a  unique  determination  of  the  roots  of  the  equations  (10.2) 
and  (10.3)  and  the  assumption  that  A  *  0  along  C  do  ue  get  a  unique  integral 
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surface.  Recall  that  in  the  linear  case  tuo  integral  surfaces  intersect  smoothly 
(i.e.  have  the  same  tangent  plane  along  their  intersection)  only  along 
characteristic  curves.  In  the  general  case  this  can  also  happen  along  the  curve 
where  the  transition  from  one  root  of  p  and  q  to  another  takes  place.  To 
simplify  the  following  discussion  we  will  assume  that  p  and  q  are  given  along  C, 
such  that  equations  (10.2)  and  (10.3)  are  satisfied.  In  other  word  the  initial 
data  is  an  initial  strip  denoted  by  C^.  Again  discontinuities  in  the  initial 
data  propagate  into  the  solution.  It  was  shown  IHA28) ,  that  if  the  initial  data 
does  not  have  continuous  second  derivatives,  then  the  solution  does  not  have 
continuous  first  derivatives.  To  understand  this  fact,  recall  the  lemma  of 
Schwarz: 

Let  G  be  a  simply  connected  region  in  R  ,  f:G  -♦  R.  If  fK,  f  and  fyy  exist 
and  are  continuous,  then  f  exists  and  f  -  f  . 

yx  xy  yx 

Furthermore  for  p  and  q  to  be  the  partial  derivatives  of  z,  they  have  to  satisfy 
the  above  lemma.  Thus  if  the  initial  data  does  not  have  continuous  second 
derivatives,  then  the  lemma  of  Schwarz  is  not  satisfied  along  Cj,  uhich  implies 
that  p  and/or  q  are  discontinuous. 

The  case  A  =  0  is  analogous  to  the  linear  case.  If  Cj  is  a  characteristic 
strip,  then  we  get  infinitely  many  solutions.  Again  we  pose  the  question  whether 
it  is  possible  to  specify  Cj  such  that  A  «  0  and  Cj  is  not  characteristic.  Then 
the  derivatives  of  p  and/or  q  would  be  discontinuous  along  C  (which  by  the 
preceding  remarks  implies  that  the  first  derivatives  are  discontinuous).  In  that 
case  C  would  be  a  focal  curve,  i.e.  satisfying  the  equations 

dx  dy  dz 

~  .  Rp  Rq  -  «  pRp  +  qRp  (10.4) 

dt  dt  dt 
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but 

dp  dq 

*  Lv(x(t),y(t))  and  —  *  L„(x(t) ,y(t) )  (10.5) 

x  y 

dt  dt 

This  cannot  occur  as  ue  assumed  that  the  function  L(x,y)  is  continuous  and  has 

continuous  derivatives.  Thus  if  x ( t )  and  y(t)  satisfy  (10.4)  they  also  have  to 

satisfy  (10.5)  as  L  and  L..  depend  only  on  x  and  y. 
x  y 

The  last  case  ue  have  to  be  concerned  is  uhen  A  vanishes  only  along  parts  of 
C  (LER57) .  But  then  C  cannot  be  a  continuous  differentiable  function  and  the 
solution  is  going  to  have  discontinuous  derivatives. 

Ue  aluays  assumed  that  C  is  not  a  closed  curve,  as  this  uould  either 
overdetermine  the  problem  or  make  it  inconsistent. 


XI.  Open  questions 

Very  little  is  knoun  about  "singular"  PDE’s,  i.e.  equations  uhich  are  not 
continuous  in  all  their  variables.  Again  some  literature,  e.g.  IHAD281  can  be 
found  about  singular  second  order  PDE's. 

In  the  case  of  the  image  irradiance  equation  ue  are  concerned  about 
singularities  uhich  occur  in  the  equation  itself.  Ue  can  aluays  assume  that 
R(p,q)  is  continuous  in  p  and  q.  A  case  uhen  R(p,q)  is  not  continuous  is  uhen  the 
surface  contains  specu I ar i t i es,  uhich  can  be  represented  by  delta-functions. 
Then  a  completely  different  approach  has  to  be  taken  to  solve  the  equation.  But 
in  a  lot  of  cases  L(x,y)  is  going  to  be  discontinuous.  As  an  example  ue  use  the 
follouing  situation:  looking  through  an  electron  microscope  on  a  half-sphere 
lying  on  a  flat  surface  uhich  can  be  formulated  as: 
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I 


„2  .  „2 
p  +  q 


2  2 
x  +  y 


1  -  (x^  +  y^) 


2  2 

Along  the  contour  x  +  y  =  1  the  equation  is  discontinuous.  In  this  case  the 
contour  is  called  an  occluding  contour.  Informally  ue  can  say  that  if  L(x,y)  is 
discontinuous  then  the  derivatives  of  the  integral  surface  are  going  to  be 
discontinuous.  By  specifying  the  solution  along  the  curve  C*  where  the 
discontinuity  occurs,  we  can  still  find  an  integral  surface.  As  z  does  not 
appear  explicitly  in  the  equation,  only  the  projection  of  C’  onto  the  x-y  plane 
can  be  found  directly  from  the  equation.  Rigorous  proofs  of  these  claims  are 
going  to  appear  in  a  subsequent  paper. 

Ue  always  assumed  that  the  integral  surface  is  continuous.  Discontinuities 
in  z  correspond  to  gaps  and  for  these  kind  of  situations  the  image  irradiance 
equation  is  inadequate. 

Another  open  problem  is  how  to  deal  with  discontinuities  in  the  image 

intensity  gradient,  i.e.  discontinuity  in  L  and/or  L  .  To  be  able  to  integrate 

x  y 

the  characteristic  equations  we  had  to  assume  that  the  first  derivatives  of  L  and 
R  are  continuous.  Ue  conjecture  that  the  case  of  discontinuities  in  the  first 
derivatives  can  be  treated  in  an  analogous  fashion  as  the  cases  of 
discontinuities  in  the  functions  themselves. 

The  image  irradiance  equation  describes  some  of  the  important  features  of  the 
"real"  world.  There  is  evidence  that  human  beings  deduce  a  lot  of  information 
about  the  shape  of  an  object  by  looking  at  its  contours  and  registering  the 
"grey"  levels.  Ue  discussed  how  these  tuo  pieces  of  evidence  are  tied  together 
in  a  single  partial  differential  equation.. 
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